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1  Introduction 

Under  what  conditions  does  a  given  set  of  inference  rules  define  a  computationally 
trcictable  inference  relation?  This  is  a  syntactic  question  about  syntactic  infer¬ 
ence  rules.  There  are  a  variety  of  motivations  for  identifying  tractable  inference 
relations.  Tractable  inference  relations  sometimes  provide  decision  procedures  for 
semantic  theories.  For  example,  the  equational  inference  rules  of  reflexivity,  sym¬ 
metry,  transitivity,  and  substitutivity  define  a  tractable  inference  relation  that 
yields  a  decision  procedure  for  the  entailment  relation  between  sets  of  ground 
equations  [Kozen,  1977],  [Shostack,  1978).  Tractable  inference  relations  can  also 
provide  useful  incomplete  inference  in  cases  where  complete  inference  is  intractable. 
Many  practical  search  algorithms  use  some  form  of  incomplete  inference  to  prune 
nodes  in  the  search  tree  [Knuth,  1975],  [Mackworth,  1977],  [Pearl  and  Korf,  1987]. 
Incomplete  inference  also  plays  an  important  role  in  pruning  search  in  constraint 
logic  programming  [Jaffar  and  Lassez,  1987],  [van  Hentenryck,  1989],  [McAllester 
and  Siskind,  1992].  Tractable  inference  relations  can  also  be  used  to  define  a  no¬ 
tion  of  “obvious  inference”  which  can  then  be  used  in  “Socratic”  proof  verification 
systems  which  require  proofs  to  be  reduced  to  obvious  steps  [McAllester,  1989], 
[Givan  et  ai,  1991]. 

Inference  rules  are  syntactically  similar  to  first  order  Horn  clauses.  In  fact, 
most  inference  rules  can  be  S3mtactically  represented  by  a  Horn  clause  in  sorted 
first  order  logic.  If  i2  is  a  set  of  Horn  clauses,  S  is  set  of  ground  atomic  formulas, 
and  $  is  a  ground  atomic  formula,  then  we  write  E  l“K$ifEUi2l-$in 
first  order  logic.  We  write  H/i  rather  than  because  we  think  of  i?  as  a  set  of 
syntactic  inference  rules  and  !-«  as  the  inference  relation  generated  by  those  rules. 
Throughout  this  paper  we  use  the  term  “rule  set”  and  “Horn  set”  interchangeably. 
Technically  this  phrase  to  refers  to  a  finite  set  of  Horn  clauses.  We  give  nontrivial 
conditions  on  R  which  ensure  that  the  inference  relation  Ha  is  polynomial  time 
decidable. 


One  rather  simple  condition  ensuring  the  tractability  of  Ha  is  that  R  be  “su¬ 
perficial”.  We  call  a  Horn  clause  A  'i’2  A  •  •  •  A  ^  superficial  if  every  term 
appearing  in  the  conclusion  $  also  appears  in  some  antecedent  Several  authors 
have  observed  that  if  i2  is  a  finite  set  of  superfici2d  Horn  clauses  then  Ha  is  polyno¬ 
mial  time  decidable  [Aho  and  UUman,  1979],  [Papaulimitriou,  1985].  Building  on 
independent  results  of  Vardi  and  Immennan,  Papadimitriou  showed  that  superfi¬ 
cial  Horn  sets  provide  a  characterization  of  the  complexity  class  P  [Vardi,  1982], 
[immerman,  1986],  [Papadimitriou,  1985].  Let  V  be  any  polynomi2J  time  predicate 
on  k  first  order  terms.  Papadimitriou  showed,  in  essence,  that  for  any  such  V  there 
exists  a  set  of  superficial  Horn  clauses  such  that  for  any  first  order  terms  tj,  tj, 
...  t*  we  have  that  V{ti^  <2,  ...  if  and  only  if  Input(ti,  tj,  ...  t*)  Ha  Accept 
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where  Input  is  a  predicate  symbol  and  Accept  is  a  distinguished  proposition  sym¬ 
bol.  We  can  think  of  a  set  of  Horn  clauses  as  a  Prolog  program.  Papadimitriou’s 
result  can  be  interpreted  as  saying  that  the  class  of  superficial  Prolog  programs 
defines  all  and  only  polynomial  time  relations. 

Superficial  Horn  sets  are  a  special  case  of  the  more  general  class  of  local  Horn 
sets  [McAllester,  1990].  A  set  ^  of  Horn  clauses  is  local  if  whenever  E  hj*  $  there 
exists  a  proof  of  $  from  E  such  that  every  term  in  the  proof  is  mentioned  in  E  or 
$.  If  is  local  then  is  pol3momial  time  decidable.  All  superficial  Horn  sets  are 
local  but  many  local  Horn  sets  are  not  superficial.  The  set  of  the  four  inference 
rules  for  equality  is  local  but  not  superficial.  The  local  inference  relations  provide 
a  different  characterization  of  the  complexity  class  P.  In  section  5  we  prove  that 
for  any  predicate  V  oi  k  first  order  terms,  V  can  be  computed  in  pol3momial  time 
if  and  only  if  there  exists  a  local  Horn  set  R  such  that  for  any  terms  ti,  <2,  ...  tk 
we  have  that  <21  •••  <fc)  if  and  only  if  hjj  P(ti,  t2,  ...  ik)  where  P  is  a 

predicate  symbol  representing  V. 

Unlike  superficiality,  locality  can  be  difiScult  to  recognize.  The  set  of  four  infer¬ 
ence  rules  for  equality  is  local  but  the  proof  of  this  fau:t  is  nontrivial.  In  section  5 
we  give  a  proof  that  locality,  as  a  property  of  sets  of  Horn  clauses,  is  undecidable. 
However,  there  are  subclasses  of  local  Horn  sets  which  can  be  mechanically  recog¬ 
nized.  A  notion  of  a  strongly  local  rule  set  is  defined  in  [McAllester,  1990]  and  a 
procedure  is  given  which  will  automatically  recognize  the  locality  of  any  strongly 
local  rule  set.  The  set  of  the  four  basic  rules  for  equality  is  strongly  local.  As  an¬ 
other  example  of  a  strongly  local  rule  set  we  give  the  following  rules  for  reasoning 
about  a  monotone  operator  from  sets  to  sets. 

xCx,  xCyAyCz=>-xCz 
xCy=^  /(x)  C  /(y) 

A  variety  of  other  strongly  local  rule  sets  are  given  [McAllester,  1990].  As  an 
example  of  a  rule  set  that  is  local  but  not  strongly  local  we  give  the  following  rules 
for  reasoning  about  imion  and  intersection  operations  on  sets.^ 

xCx,  xCyAyCz=»xCz 

xCxUy,  yCxUy,  xCzAyCr=»^xUyCz 

xflyCx,  xflyCy,  zCxAzCy=>-zCxny 

These  rules  remain  local  when  the  above  monotonicity  rule  is  added.  With  or 
without  the  monotonidty  rule,  the  rule  set  is  not  strongly  local. 

^  These  rules  are  complete  for  reasoning  about  lattice  operations.  We  phrase  them  as  rules 
about  sets  because  we  believe  this  is  how  they  are  most  commonly  used. 
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In  this  paper  we  construct  another  machine-recognizable  subclass  of  the  local 
Horn  sets  which  we  call  inductively  local  Horn  sets.  All  of  the  strongly  local  rule 
sets  given  in  [McAllester,  1990]  are  also  inductively  local.  The  procedure  described 
in  section  4  for  recognizing  inductively  local  rule  sets  has  been  implemented  and 
has  been  used  to  determine  that  the  above  rule  set  is  inductively  local.  Hence 
the  inference  relation  defined  by  the  rules  is  polynomial  time  decidable.  We  have 
been  able  to  show  that  there  are  strongly  local  rule  sets  which  are  not  inductively 
local,  although  our  examples  are  somewhat  artificial.  We  have  not  found  any 
natural  examples  of  local  rule  sets  that  fail  to  be  inductively  local.  Polynomizd 
time  inference  relations  have  a  variety  of  applications.  Inductively  local  rule  sets 
provide  a  variety  of  mechanically  recognizable  polynomial  time  inference  relations. 


2  Basic  Terminology 

In  this  section  we  give  more  precise  definitions  of  the  concepts  discussed  in  the 
introduction. 

Definition:  A  Horn  clause  is  a  first  order  formula  of  the  form  A 
A  . . .  A  =►  $  where  $  each  'i',-  is  an  atomic  formula.  For  any  set 
of  Horn  clauses  R,  any  finite  set  E  of  ground  terms,  and  any  ground 
atomic  formula  $,  we  write  E  $  if  E  U  U(R)  h  $  in  first  order 
logic  where  U (R)  is  the  set  of  xmiversal  closures  of  Horn  clauses  in  R. 

There  are  a  variety  of  inference  relations  defined  in  this  paper.  For  imy  inference 
relation  h  and  any  sets  of  groimd  formulas  E  and  F  we  write  E  h  F  if  E  h  ’J'  for 
each  ’i'  in  F. 

The  inference  relation  h/i  can  be  given  a  more  direct  syntactic  characterization. 
This  syntactic  characterization  is  more  useful  in  determining  locality. 

Definition:  A  derivation  of  $  from  E  using  Horn  set  is  a  sequence 
of  ground  atomic  formulas  'Pi,  such  that  is  $  and  for 

each  'I',-  there  exists  a  Horn  clause  0i  A  @i  A  . . .  A  @j^  in  i2  and 
a  ground  substitution  <t  such  that  is  and  each  formula  of  the 
form  is  either  a  member  of  E  or  a  formula  appearing  in  earlier  in 
the  derivation. 

Lemma:  E  hj?  $  if  and  only  if  there  exists  a  derivation  of  $  from  E 
using  the  Horn  set  R. 
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The  following  restricted  inference  relation  plays  an  important  role  in  the  anal¬ 
ysis  of  locality. 

Definition:  We  write  E  Ha  $  if  there  exists  a  derivation  of  $  form 
E  such  that  every  term  appearing  in  the  derivation  apears  as  a  subex¬ 
pression  of  $  or  as  a  subexpression  of  some  formula  in  E. 

Lemma:  For  any  finite  Horn  set  R  the  inference  relation  H/j  is 
polynomial  time  decidable. 

Proof:  Let  n  be  the  number  of  terms  that  appear  as  subexpressions 
of  $  or  a  formula  in  E.  K  P  is  a  predicate  of  k  arguments  that  appears 
in  the  inference  rules  R  then  there  are  at  most  n*  formulas  of  the  form 
P(si,  ...  Sic)  such  that  E  H  P(si,  . . .  s^).  Since  R  is  finite  there  is 
some  maximum  arity  over  all  the  predicate  symbols  that  appear  in  R. 

The  total  number  of  formulas  that  can  be  derived  under  the  restrictions 
in  the  definition  of  H  is  order  n*  where  k  is  the  maximum  arity  of 
the  predicates  in  R.  m 

Clearly,  if  E  h  $  then  E  hfl  $.  But  the  converse  does  not  hold  in  general. 
By  definition,  if  the  converse  holds  then  R  is  local. 

Definition:  The  Horn  set  R  is  local  if  the  restricted  inference  relation 
Ha  is  the  same  as  the  unrestricted  relation  1-^. 

Clearly,  if  P  is  local  then  Ha  is  polynomial  time  decidable. 


3  Another  Characterization  of  Locality 

In  this  section  we  give  an  alternate  characterization  of  locality.  This  characteri¬ 
zation  of  locality  plays  an  important  role  in  both  the  definition  of  strongly  local 
nile  sets  given  in  [McAUester,  1990]  and  in  the  notion  of  inductively  local  rule  sets 
given  here. 

Definition:  A  bounding  set  is  a  set  T  of  groimd  terms  such  that  every 
subterm  of  a  member  of  T  is  also  a  member  of  T. 

Definition:  A  ground  atomic  formula  '9^  is  called  a  label  formula  of  a 
bounding  set  T  if  every  term  in  is  a  member  of  T. 
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Definition:  For  any  bounding  set  T,  we  define  the  inference  relation 
b*  R,r  to  be  such  that  E  h  $  if  and  only  if  there  exists  a  derivation 
of  $  from  E  such  that  every  formula  in  the  derivation  is  a  label  formula 
of  the  term  set  T. 

We  have  that  E  H  ^  $  if  and  only  if  E  H  $  where  T  is  the  set  of  all 
terms  appearing  as  subexpressions  of  $  or  formulas  in  E.  The  inference  relation 
h  can  be  used  to  give  2uiother  characterization  of  locality.  Suppose  that  R 
is  not  local.  In  this  case  there  must  exist  some  E  and  $  such  that  E  ^  $  but 
E  \-R  Let  T  be  the  set  of  terms  that  appear  in  E  and  $.  We  must  have 
E  R  f  However,  since  E  h/i  $  we  must  have  E  H  r;[i  $  for  some  finite 
superset  T'  of  T.  Consider  “growing”  the  bounding  set  one  term  at  a  time,  starting 
with  the  terms  that  appear  in  E  and 

Definition:  A  one  step  extension  of  a  boimding  set  T  is  a  ground  term 
a  that  is  not  in  T  but  such  that  every  proper  subterm  of  a  is  a  member 
of  T. 

Definition:  An  feedback  event  for  R  consists  of  a  finite  set  E  of  ground 
formulas,  a  ground  formula  $,  a  bounding  set  T  containing  all  terms 
that  appear  in  E  and  $,  and  a  one  step  extension  a  of  T  such  that 
S  H  /i,Tu{a}  $  but  E  ^ 

By  abuse  of  notation,  a  feedback  event  will  be  written  as  E  H  /e,Tu{or} 

Lemma:  R  is  local  if  and  only  if  there  are  no  feedback  events  for  R. 

Proof:  First  note  that  if  R  has  a  feedback  event  then  R  is  not  local 
—  if  E  ^  then  E  hji  $  but  if  E  r  ^  $  then  E  ^ 

Conversely  suppose  that  R  is  not  local.  In  there  case  there  is  some 
E  and  9  such  that  H  r  ^  but  E  H  $  for  some  finite  T.  By 
considering  a  least  such  T  one  can  show  that  a  feedback  event  exists 
for  R.  m 

The  concepts  of  strong  locality  and  inductive  locality  both  involve  the  concept 
of  a  feedback  event.  We  can  define  strong  locality  by  first  defining  C|{(E,  T)  to  be 
the  set  of  of  formulas  9  such  that  E  H  r^i  i2  is  strongly  local  if  it  is  local  and 
there  exists  a  natural  number  k  such  that  whenever  S  H  A.Tu{a}  there  exists  a 
derivation  of  ®  from  Ca(E,  T)  such  that  every  term  in  the  derivation  is  a  member 
of  T  U  {a}  and  such  that  the  derivation  is  no  longer  than  k.  As  mentioned  above, 
the  set  of  the  four  basic  inference  niles  for  equality  is  strongly  local  and  there 
exists  a  procedure  which  can  recognize  the  locality  of  any  strongly  local  rule  set. 
The  definition  of  inductive  locality  is  somewhat  more  involved  and  is  given  in  the 
n«ct  section. 
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4  Inductive  Locality 


To  define  inductive  locality  we  first  define  the  notion  of  a  feedback  template.  A 
feedback  template  represents  a  set  of  potential  feedback  events.  We  also  define  a 
backward  chaining  process  which  generates  feedback  templates  from  a  Horn  set  R. 
We  show  that  if  there  exists  a  feedback  event  for  R  then  such  an  event  will  be  found 
by  this  backchaining  process.  Furthermore,  we  define  an  “inductive”  termination 
condition  on  the  backchaining  process  and  show  that  if  the  backchaining  process 
achieves  inductive  termination  then  R  is  local. 

Throughout  this  section  we  let  i2  be  a  fixed  but  arbitrary  set  of  Horn  clauses. 
The  inference  relation  h  will  be  written  as  h  x  with  the  understanding 
that  is  an  implicit  parameter  of  the  relation. 

We  define  feedback  templates  as  ground  objects  —  they  contain  only  ground 
first  order  terms  and  formulas.  The  process  for  generating  feedback  templates  is 
defined  as  a  ground  process  —  it  only  deals  with  groimd  instances  of  clauses  in  R. 
The  ground  process  can  be  “lifted”  using  a  lifting  transformation.  Since  lifting  is 
largely  mechanical  for  arbitrary  groimd  procedures  [McAllester  and  Siskind,  1992], 
the  lifting  operation  is  only  discussed  briefly  here. 

Definition:  A  feedback  template  consists  of  a  set  of  ground  atomic 
formulas  S,  a  multiset  of  ground  atomic  formulas  F,  a  ground  atomic 
formula  $,  a  bounding  set  T,  and  a  one  step  extension  a  of  T  such 
that  $  and  every  formula  in  E  is  a  label  formula  of  T,  every  formula 
in  r  is  a  label  formula  of  T  U  {a}  that  contains  a,  and  such  that 
E  U  r  h  Tu{oi} 

By  abuse  of  notional  a  feedback  template  will  be  written  as  E,  F  H  Tu{a} 

F  is  a  multisetset  of  ground  atomic  formulas,  each  of  which  is  a  label  formula  of 
Tu{a}  containing  a,  and  such  that  the  union  of  E  and  F  allow  the  derivation  of  $ 
relative  to  the  bounding  set  T  U  {a}.  A  feedback  template  is  a  potential  feedback 
event  in  the  sense  that  an  extension  of  E  that  allows  a  derivation  of  the  formulas 
in  F  may  result  in  a  feedback  event.  The  need  to  make  F  a  multiset  rather  than  a 
set  is  discussed  below.  Feedback  templates  for  R  can  be  constructed  by  backward 
chaining. 

Procedure  for  Generating  a  Template  for  Ri 

1.  Let  1 A  A  •  •  •  A  '®n  ^  ^  be  a  ground  instance  of  a  clause  in  R. 

2.  Let  a  be  a  term  that  appears  in  the  clause  but  does  not  appear 
in  the  conclusion  9  and  does  not  appear  as  a  proper  subterm  of 
any  other  term  in  the  clause. 
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3.  Let  T  be  a  bounding  set  that  does  not  contain  a  but  does  contain 
every  term  in  the  clause  other  than  a. 

4.  Let  E  be  the  set  of  antecedents  ’I',-  which  do  not  conain  a. 

5.  Let  r  be  the  set  of  antecedents  which  do  conaint  a. 

6.  Return  the  feedback  template  E,  F  h  tu{o} 

We  let  T o[R]  to  be  the  set  of  all  feedback  templates  that  can  be  derived  from 
^  by  an  application  of  the  above  procedure.  We  leave  it  to  the  reader  to  verify 
that  To[R]  is  a  set  of  feedback  templates.  Now  consider  a  feedback  template 
E,r  hxu{o}  We  can  construct  a  new  template  by  backward  chaining  from 
E,  r  h  Tu{a}  ^  using  the  following  procedure. 

Procedure  for  Backchaining  from  E,r  H  tu{o}  ^ 

1.  Let  6  be  a  member  of  F 

2.  Let  A  'J'j  A  •  •  •  A  =►  0  be  a  ground  instances  of  a  clause  in 
R  that  has  6  as  its  conclusion  and  such  that  each  is  a  label 
formula  of  T  U  {a}. 

3.  Let  E'  be  E  plus  all  antecedents  which  do  not  contain  a. 

4.  Let  F'  be  F  minus  0  plus  all  antecedents  which  do  contain  a. 

5.  Return  the  template  E',  F'  H  tu{o} 

In  step  4  of  the  above  procedure,  F'  is  constructed  using  multiset  opertions. 
For  example,  if  the  multiset  F  contains  two  occtirances  of  0,  then  “F  minus  0” 
contains  one  occurance  of  0.  The  use  of  multisets  ensures  that  backchaining  steps 
“conunute” .  To  see  this  let  E,  F  H  Tu{ar}  $  be  a  template  zmd  let  0i  and  02  be  two 
elements  of  F.  Select  two  Horn  clauses  for  backchaining  on  0]  and  02  respectively 
and  let  E",  F"  h  Tu{a}  ^  be  the  result  of  performing  these  two  backchaining  steps. 
The  use  of  multisets  ensures  that  the  template  E",  F''  h  tu{o}  ^  is  independent  of 
the  order  in  which  the  two  backchaining  steps  are  done.  Suppose  we  use  sets  rather 
than  multisets  and  suppose  that  backchaining  on  0i  generates  02  as  a  subgoal.  In 
this  case  backchaining  on  0i  and  then  backchaining  on  02  eliminates  all  occurances 
of  02,  while  backchining  on  02  and  then  backchaining  on  0i  leaves  an  occurance  of 
02*  The  use  of  multisets  rather  than  sets  guarantees  that  in  this  case  the  subgoal 
03  remains  under  either  order  of  backchaining.  The  commutativity  of  backchaining 
steps  simplifies  the  inductive  termination  test  considered  below. 

For  any  set  T  of  feedback  templates  we  define  B[T]  to  be  T  plus  all  templates 
that  can  be  derived  from  an  element  of  T  by  an  application  of  the  above  backchain¬ 
ing  procedure.  It  is  important  to  keep  in  mind  that  by  definition  5[T]  contains  T. 
We  let  B"[T]  be  B[B[’  •  •  B[T]]]  with  n  applications  of  B. 
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Definition:  A  feedback  template  E,  F  H  tu{o}  ^  is  called  critical  if  F 
is  empty. 

If  E,  0,  H  Tu{a}  ^  is  a  critical  template  then  E  H  Tu{a}  If  S  1/  t  ^ 

S  H  Tu{a>  ^  is  a  feedback  event.  By  abuse  of  terminology,  a  critical  template 
S,  0  H  Tu{c»}  ^  such  that  E  i-  ^  ^iii  called  a  feedback  event.  The  following 
lemma  provides  the  motivation  for  the  definition  of  a  feedback  template  and  the 
backchaining  process. 

Lemma:  There  exists  a  feedback  event  for  R  if  and  only  if  there  exists 
a  j  such  that  B'’[To[i2]]  contains  a  feedback  event. 

Proof:  To  prove  the  above  lemma  suppose  that  there  exists  a  feedback 
event  for  R.  Let  E  H  Tu{a}  $  be  a  minimal  feedback  event  for  R,  i.e., 
a  feedback  event  for  R  which  minimizes  the  length  of  the  derivation  of 
$  from  E  imder  the  bounding  set  TU  {a}.  The  fact  that  this  feedback 
event  is  minimal  implies  that  every  formula  in  the  derivation  other  than 
$  contains  a.  To  see  this  suppose  that  6  is  a  formula  in  the  derivation 
other  than  $  that  does  not  involve  a.  We  then  have  E  h  tu{£»}  ®  a^d 
E  U  {0}  H  Tu{a}  One  of  these  two  must  be  a  feedback  event  — 
otherwise  we  would  have  E  H  x  But  if  one  of  these  is  a  feedback 
event  then  it  involves  a  smaller  derivation  than  E  h  xu{a}  ^  J^nd  this 
contradicts  the  assumption  that  E  h  Tu{a}  ^  is  minimal.  Since  every 
formula  other  than  $  in  the  derivation  underlying  E  Hxu{a}  $  contains 
a,  the  template  E,0  H  Tu{a}  ^  can  be  derived  by  backchaining.  ■ 

The  above  lemma  implies  that  if  the  Horn  set  is  not  local  then  backchaining 
will  uncover  a  feedback  event.  However,  we  are  primarilly  interested  in  those  cases 
where  the  Horn  set  is  local.  If  the  backchaining  process  is  to  establish  locality  then 
we  must  find  a  termination  condition  which  guarantees  locality.  Let  T  be  a  set  of 
feedback  templates.  In  practice  T  can  be  taken  to  be  B'[T o[i2]]  for  some  finite  j. 
We  define  a  "self-justification”  property  for  sets  of  feedback  templates  and  prove 
that  if  T  is  self-justifying  then  there  is  no  n  such  that  B^\T\  contain  a  feedback 
event.  In  defining  the  self-justification  property  we  treat  each  template  in  T  as  an 
independent  induction  hypothesis.  If  each  template  can  be  “justified”  using  the 
set  of  templates  as  induction  hypotheses,  then  the  set  T  is  self-justifying. 

Definition:  We  write  E,  F  H  ^  ^  $  if  T  contains  templates 

BjjFi  Hxu{a}  EajFj  Hxu{«}  •••  B*,F/t  Hxu{a} 

where  each  Et  is  a  subset  of  E,  each  F,  is  a  subset  of  F  and  E  U 

{^1,  ...  Hr 
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^  Definition:  T  is  said  to  justify  a  template  E,  F  h  Tu{a}  ^  if  there 

exists  a  0  €  F  such  that  for  each  template  E',  F'  h  tu{o}  ^  generated 
by  backchaining  from  E,F  HTru{a}  ^  by  selecting  0  at  step  1  of  the 
backchaining  procedure  we  have  E',  F'  H  ^  ^ 

Definition:  The  set  T  is  called  self-justifying  if  every  member  of  T  is 
either  critical  or  justified  by  T,  and  T  does  not  contain  any  feedback 
events. 

Induction  Theorem:  If  T  is  self-justifying  then  no  set  of  the  form 
contains  a  feedback  event. 

Proof:  We  must  show  that  for  every  critical  template  E,0  h  Tu{a}  ^ 
in  we  have  that  E  Hr  The  proof  is  by  induction  on  n. 

Consider  a  critical  template  E,0  Hyu{o}  ^  iii  and  assume  the 

theorem  for  all  critical  templates  in  B^^T]  for  j  less  than  n.  The  critical 
template  E,  0  h  Tu{ot}  ^  must  be  derived  by  backchaining  from  some 
template  E',  F'  H  Tu{a}  ^  in  Note  that  E'  must  be  a  subset  of  E.  If 
F'  is  empty  then  E'  equals  E  and  E  h  t  $  because  T  is  assumed  not 
to  contain  any  feedback  events.  If  F'  is  not  empty  then,  since  T  is  self 
I  justifying,  there  must  exist  some  0  in  F'  such  that  for  each  template 

r  E",  F"  H  Tu{a}  ^  derived  from  E',  F'  H  Tufo}  ^  hy  backchaining  on  0 

we  have  E",  F"  H  ^  We  noted  above  that  backchaining  operations 
commute.  By  the  commutativity  of  backchidning  steps  there  exists  a 
backchaining  sequence  from  E',F'  Hxu{o}  $  to  E,0  HTu{ot}  ^  such 
that  the  first  step  in  that  sequence  is  a  backchaining  step  on  0.  Let 
E",  F"  h  Tu{tt}  ^  be  the  template  that  results  from  this  backchaining 
step  from  E',  P  H  Tu{a}  Note  that  E"  is  a  subset  of  E.  We  must 
now  have  E",  F"  H  ^  ^ •  By  definition,  T  must  contain  templates 

Bi,Fi  H-)ru{a)  B3,Fa  Hxu{a}  •••  B*,F*  Hxuta} 

such  that  each  E,-  is  a  subset  of  E",  each  Fi  is  a  subset  of  F",  and 
E"  U  {'I'l,  ...  y?*}  Hx  Note  that  each  E^  is  a  subset  of 

E.  Since  F,-  is  a  subset  of  F"  there  must  be  a  sequence  of  fexotr  than 
n  backdiaining  steps  that  leads  from  Ei,Fi  Hxu{oi}  to  a  critical 
template  EJ,0  Hxu{a}  Note  that  EJ  is  a  subset  of  E.  This 
critical  template  is  a  member  of  B^[T]  for  j  less  than  n  so  we  have 
EJ  H  X  and  thus  E  H  x  But  if  E  H  x  for  each  ’®,-,  and 
E  U  {'i’l,  'i'a,  • . .  H  X  then  E  H  x  $.  ■ 

We  now  come  the  main  definition  and  theorem  of  this  section. 

\ 
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Definition:  A  Horn  set  R  is  called  inductively  local  if  there  exists  some 
n  such  that  ^"[ToIiZ]]  is  self-justifying. 

Theorem:  There  exists  a  procedure  which,  given  any  finite  set  R  of 
Horn  clauses,  will  terminate  with  a  feedback  event  whenever  R  is  not 
local,  terminate  with  “success”  whenever  R  is  inductively  local,  and 
fail  to  terminate  in  cases  where  R  is  local  but  not  inductively  local. 

The  procedure  is  derived  by  lifting  the  above  ground  procedure  for  computing 
B”[T[i2]].  Lifting  can  be  formalized  as  a  mech2Uiical  operation  on  arbitrary  nonde- 
terministic  ground  procedures  [McAUester  and  Siskind,  1992].  In  the  lifted  version 
the  infinite  set  B''[To[i2]]  is  represented  by  a  finite  set  of  “template  schemas”  each 
of  which  consists  of  a  template  expression  S,  F  H  Tu{a}  ^  involving  variables  plus  a 
set  of  constraints  on  those  variables.  Lifting  always  converts  a  ground  computation 
to  a  lifted  computation  resulting  in  a  data  structure  containing  variables  together 
with  constraints  on  those  variables.  In  this  case  all  of  the  terms  in  E,  F  H  tu{o}  ^ 
may  contain  first  order  variables  and  T  is  a  variable  ranging  over  bounding  sets. 
The  variable  T  is  subject  to  the  constraint  a  ^  T  and  a  set  of  constraints  of  the 
form  t  €  T  where  t  is  a  first  order  term.  Thore  exists  a  simple  procedure  for  deter¬ 
mining  if  these  constraints  are  satisfiable,  i.e.,  if  there  exists  a  ground  substitution 
a  and  a  ground  bounding  set  T  satisfying  these  constraints.  It  is  also  possible  to 
construct  a  procedure  that  determines  if  B"[To[/l]]  is  self- justifying  by  examining 
the  finite  set  of  template  schemas  constructed  by  the  lifted  computation. 


5  Locality  is  Undecidable 

To  prove  that  locality  is  undecidable  we  start  with  Papadimitriou’s  result  that 
superficial  Horn  sets  can  represent  any  polynomial  time  predicate.  Let  V  be  any 
polynomial  time  predicate  on  first  order  terms.  Papadimitriou  proved  that  a  poly¬ 
nomial  time  bounded  Turing  machine  for  computing  "P  can  be  mechanically  con¬ 
verted  to  a  superficial  Horn  set  R  such  that  for  any  first  order  terms  /i,  <2»  •  •  •  fit  we 
have  that  V{tu  ...  fn)  if  and  only  if  Input(ti,  <3,  ...  /*)  Accept  where 
Input  is  a  predicate  symbol  and  Accept  is  a  distinguished  proposition  symbol.^ 
The  first  step  in  proving  that  locality  is  undecidable  is  to  convert  i2  to  a  local  Horn 
set  R  such  that  for  any  li,  <3,  . . .  f*  we  have  that  V{ti,  <3,  ...  t*)  if  and  only  if 
l-n  Pih,  <3,  ...  ffc). 

’Papadimitriou’s  result  is  actually  somewhat  different.  He  only  uses  Horn  clauses  that  do 
not  contain  .my  function  symbols  other  than  constants  but  then  requires  more  input  premises. 
Papadimitriou’s  result  can  be  used  to  prove  the  result  stated  here  by  constructing  additional 
clauses  that  allow  the  additional  premises  needed  by  Papadimitriou’s  clauses  to  be  proved  by 
superficial  inference  rules  curating  on  the  terms  U,  <3,  . . .  f„. 
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Let  ■p  be  a  polynomial  time  predicate  on  k  first  order  terms  and  let  R  he  a. 
superficial  Horn  set  satisfying  Papadimitriou’s  condition  for  V.  For  each  predicate 
sjonbol  Q  of  m  arguments  appearing  in  R  let  Q'  be  a  new  predicate  symbol  of 
k  +  m  arguments.  We  define  the  Horn  set  Rf  to  be  the  Horn  set  containing  the 
following  clauses. 

•  Input'(xi,  ...  ifc,  xi,  ...  x*) 

•  All  clauses  of  the  form 

Ql(*li  •  •  •  ^1,1 »  •  •  •  ^n.l  I  •  •  •  ^n,m,)  ^  ^  (*1 1  •  •  •  *1 1  •  •  • 

where  the  clause  ...  •  •A(5„(<„,i,  ...  <„,«,)=»  W(si,  ...  s^) 

is  in  R. 

•  The  clause  Accept'(xi,  •••  Xk)  P(xi,  Xk). 


Given  the  above  definition  we  have  that  Hh'  ...  tk,  si»  ...  ^m)  if  and 

only  if  Input (<i,  ...  tk)  b/i  Q(ai»  ...  am).  So  Input(ti,  ...  tk)  b/i  Accept  if 
and  only  if  h/i/  P{ti,  ...  tk).  It  remains  only  to  show  that  R!  is  local.  Suppose 
that  S  hfl/  $.  We  must  show  that  E  Hr*  $.  Let  ...  tk  be  the  first  k 
arguments  in  $.  Every  inference  based  on  Rf  involves  formulas  which  all  have  the 
same  first  k  arguments.  Given  that  E  l-ji»  $  we  must  have  that  E'  1-r»  $  where 
E'  is  the  set  of  formulas  in  E  that  have  ti,  ...  tk  as  their  first  k  arguments.  Let 
E"  be  and  be  the  result  of  replacing  each  formula  Q\ti,  ...  Si,  . . . ,  s^)  by 

^(si,  ...,Sto).  Since  E'  h/j*  $  we  must  have  {input (tj,  ...  U  E"  h/j 
But  since  R  is  superficial  this  implies  that  every  term  in  the  derivation  imderlying 
{Input(tj,  . . ,  tk)}  U  E"  H/j  either  appears  in  some  U  or  appears  in  E".  This 
implies  that  every  term  in  the  derivation  appears  in  either  E'  or  $.  This  implies 
E  H  jy  $. 

We  can  now  reduce  the  halting  problem  to  the  problem  of  determining  locality. 
Let  T  be  a  specification  of  a  Turing  machine.  Let  Vt  be  the  predicate  on  first  order 
terms  which  is  true  of  a  term  c  just  in  case  c  is  a  representation  of  a  computation 
history  of  T  which  ends  in  a  halt  state.  'Pj  i®  a  polynomial  time  predicate  on 
first  order  terms.  Furthermore,  a  polynomial  time  Turing  machine  for  Vt  can  be 
computed  from  the  representation  of  T.  By  the  above  construction,  the  Turing 
machine  for  Vj  can  be  converted  to  a  loc^  rule  set  R  such  that  !-«  Pt{c)  if 
and  only  if  Pt(c).  Now  let  ^  be  plus  the  single  clause  Pr(x)  Halts  where 
Halts  is  a  new  proposition  symbol.  We  claim  that  Rf  is  local  if  and  only  if  T  does 
not  halt.  First  note  that  if  T  halts  then  we  have  \-pf  Halts  but  \/  Halts. 
Conversely,  suppose  that  T  does  not  halt  and  suppose  that  E  Hw  We  must 
show  that  E  H  $.  Suppose  $  is  some  formula  other  than  Halts.  In  this  case 
E  hji.  $  is  equivalent  to  E  Ftj  Since  R  is  local  we  must  have  E  H  ^  $  and 
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thus  E  h  /j*  Now  suppose  $  is  the  formula  Halts.  Since  E  f-/j/  Halts  we  must 
have  E  l-/i»  Pt(c)  for  some  term  c.  To  show  E  h  Halts  it  now  suffices  to  show 
that  c  is  mentioned  in  E.  By  the  preceding  argument  we  then  have  E  H  /j  Pt{c). 
Since  the  rule  set  R  vras  generated  by  the  construction  given  above,  we  have  that 
every  inference  based  on  a  clause  in  R  is  such  that  that  every  formula  in  the 
inference  has  the  same  first  argument.  This  implies  that  E'  H  Pt{c)  where  E' 
is  the  subset  of  formulas  in  E  that  have  c  as  a  first  argument.  We  have  assumed 
that  T  does  not  halt,  and  thus  /-r  Pt{c).  Hence  E'  must  not  be  empty.  So  E 
must  mention  c  and  since  E  H  ^  Pric)  we  have  E  H  jj/  Halts. 

The  use  of  Papadimitriou’s  result  can  be  eliminated  from  the  proof  that  locality 
is  undecidable.  We  could  have  started  by  giving  a  direct  proof  that  one  can  not  in 
general  determine  for  an  arbitrary  superficial  Horn  set  R  whether  there  exists  a  c 
such  that  Input (c)  Accept.  We  could  then  translate  an  arbitrary  superficial 
Horn  set  i2  to  a  Horn  set  Rf  such  that  Rf  is  local  if  and  only  if  there  does  not 
exist  a  c  such  that  Input(c)  b/t  Accept.  This  can  be  done  using  the  construction 
given  above. 


6  Discussion 

Local  rule  sets  provide  a  characterization  of  the  set  of  relations  decidable  in  poly¬ 
nomial  time.  An  understanding  of  local  rule  sets  can  lead  to  streamlined  proofs  of 
polynomial  time  decidability.  For  example,  consider  the  fact  that  any  context  free 
language  can  be  recognized  in  cubic  time.  This  fact  is  easily  proven  by  giving  a 
translation  of  grammars  into  local  rule  sets.  Consider  a  grammar  with  productions 
of  the  form  D  —*  d  and  A  — ♦  BC  where  A,  B,  C,  and  D  are  nonterminal  symbols 
and  d  is  a  terminal  symbol.  One  can  translate  these  productions  to  Horn  clauses  of 
the  form  Terminal(d,  i,  j)  ^  D{i,  j)  and  B(i,  j)  A  C{j,  k)  ^  A(t,  Jfc).  One  can 
then  add  the  clause  Tenainal(z,  con8(z,  y),  y).  One  can  readily  verify  that  this 
set  of  clauses  is  local  and  that  a  string  z  (r^resented  as  a  list)  parses  as  nontermi¬ 
nal  A  if  and  only  if  h  A(z,  nil).  Hence  context  free  parsing  is  polynomial  time. 
General  methods  for  analyzing  the  order  of  running  time  of  local  rule  sets  can  be 
used  to  immediately  give  that  these  clauses  can  be  run  to  completion  in  order 
time  where  n  is  the  length  of  the  input  string.  We  have  implemented  a  compiler 
for  converting  local  nile  sets  to  efficient  inference  procedures.  This  compiler  can  be 
used  to  automatically  generate  a  polynomial  time  parser  from  the  above  inference 
rules. 

In  addition  to  providing  a  characterization  of  the  complexity  class  P,  and  a 
convenient  way  of  representing  some  polynomial  time  algorithms,  local  inference 
relations  provide  a  variety  of  efficient  inference  techniques  that  can  be  applied 
in  situations  where  complete  inference  is  intractable.  The  inference  rules  for  set 
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inclusion  given  in  the  introduction  are  incomplete  (as  rules  as  about  set  inclusion) 
but  are  useful  nonetheless.  Efficient  but  incomplete  inference  relations  can  play  an 
important  role  in  pnming  search.  We  hope  that  progress  in  understanding  efficient 
inference  will  lead  to  better  practical  algorithms. 

In  closing  we  note  some  open  problems.  First,  although  there  is  a  close  relation¬ 
ship  between  the  complexity  class  P  and  local  rule  sets,  it  is  not  known  whether 
every  polynomial  time  inference  relation  can  be  generated  by  a  local  rule  set.  More 
precisely,  let  H  be  any  polynomi<d  time  inference  relation  such  that  $  I-  $  for  any 
ground  atomic  formula  $  and  if  E  I-  $  then  E  U  {'I'}  K  $.  Does  there  always 
exist  a  local  rule  set  which  generates  h,  or  perhaps  a  conservative  extension  of  h? 
Our  other  problems  are  less  precise.  Can  one  find  a  “natural”  rule  set  that  is  local 
but  not  inductively  local?  A  related  question  is  whether  there  are  useful  mswrhine 
recognizable  subclasses  of  the  local  rule  sets  other  than  the  classes  of  strongly  local 
and  inductively  local  rule  sets? 
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